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Abstract. We propose an abstract definition of convex spaces as sets where 
one can take convex combinations in a consistent way. A priori, a convex 
space is an algebra over a finitary version of the Giry monad. We identify the 
corresponding Lawvere theory as the category from IFriOQI and use the results 
obtained there to extract a concrete definition of convex space in terms of a 
family of binary operations satisfying certain compatibility conditions. After 
giving an extensive list of examples of convex sets as they appear through- 
out mathematics and theoretical physics, we find that there also exist convex 
spaces that cannot be embedded into a vector space: semilattices are a class 
of examples of purely combinatorial type. In an information-theoretic inter- 
pretation, convex subsets of vector spaces are probabilistic, while semilattices 
are possibilistic. Convex spaces unify these two concepts. 



Looking at the history of mathematics, one easily finds an abundance of cases 
where abstract generahzations of concrete structures into abstract concepts spurred 
a variety of interesting developments or even opened up completely new fields. Some 
of the most obvious examples that spring to mind are: 

• The concept of a group, which provides an abstract framework for the study 
of symmetries. 

• Riemannian manifolds, were modelled after submanifolds of M" with their 
intrinsic geometry. 

• Category theory, conceived as an abstract framework for cohomology theo- 
ries. 



I would like to thank the Max Planck Institute for providing an excellent research environment 
and finanical support. Branimir Cacic and Jens Putzka provided helpful comments on a previous 
version of this paper. 
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• Operators on Hilbert space, which generahze the Fourier transform and 
integral equations. 

We now consider the notion of convexity as that property of a subset of a vector 
space that means that the set contains the Hne segment connecting every two points 
in that subset. Perhaps surprisingly, an abstract generalization has not (yet) been 
proposed for this concept of convexity. To the author's knowledge, the present 
literature does not contain any concept of abstract convex set that provides a nice 
notion of convex combinations for its elements. The aim of this paper is to remedy 
this omission. We note however that ideas similar to the ones presented here also 
appeared in the online discussion |Lei08] . at about the same time as the present 
work started to take shape. 

We shall call a set together with a certain notion of abstract convex combinations 
a convex space. The most obvious examples are convex subsets of vector spaces. 
However, there is an entirely different class of convex spaces all of which are of 
a discrete nature, namely meet-semilattices, where the meet operation serves as a 
convex combination operation. Moreover, one can also construct examples of mixed 
type, where one has a semilattice as an underlying discrete structure, together with 
a convex subset of a vector space over each element of the semilattice. This is 
similar to how one can project a polytope onto its face lattice by mapping each 
point to the face it generates: then, the polytope becomes a "fiber bundle" over 
its face lattice with the face interiors as fibers. We will describe a variant of this 
construction in |Frij and show that every convex space is of such a form. 

Our main motivation for studying this subject comes from quantum mechan- 
ics, in particular the search for the most general framework for theories of physics. 
Without loss of generality, we can assume a theory of physics to be of epistemologi- 
cal nature; this means that what we describe is not the actual reality of the system 
itself, but merely the information an observer has about the system. Now informa- 
tion is usually incomplete, in which case the state that the observer believes the 
system to be in is given by a statistical ensemble. Therefore, it seems reasonable 
to assume that the set of the information states has the mathematical structure of 
convex combinations, which correspond to statistical superpositions of ensembles. 
This is the framework known as general probabilistic theories |Bar06] . where the 
set of information states is taken to be a convex subset of a vector space. However 
since the underlying vector space lacks any physical motivation and solely serves 
the purpose of defining the convex combinations, we felt the need to develop an 
abstract concept of convex spaces. 

We now give an outline of the paper. After settling notation in section |2] we 
start section |3] by proposing our definition of convex spaces in terms of a family of 
binary operations satisfying certain compatibility conditions. Using concepts from 
category theory, we then show that these compatibility conditions imply all the 
relations that we expect convex combinations to have. The main step relies on the 
results of |Fri09] . As a first exercise in the theory of convex spaces, we then show 
in theorem |3.9| how a convex space structure on a set is uniquely determined by the 
collection of those maps that preserve convex combinations. 

The remaining three sections are entirely dedicated to various classes of exam- 
ples. Section |4] then proceeds by giving a list of examples of "geometric type" , 
which refers to those convex spaces that can be written as a convex subset of a 
vector space. Then in section |5] we study a discrete class of convex spaces. A 
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discrete convex space in that sense turns out to be the same thing as a semilattice. 
None of these can be embedded into a vector space. Finally, section [6] describes 
constructions of convex spaces that have both a geometric and a combinatorial fla- 
vor. This concludes the paper. We hope that the long list of examples explains 
why we deem convex spaces worthy of study. 



2. Notation 

The typewriter font denotes a category, for example Set. As in |Fri09] . we 
write [n] as shorthand for the n-element set {1, . . . , n}. The symbol * stands for 
any one-element set and also for the unique convex space over that set. For a real 
number a G [0, 1], we set a = 1 — a. This notation increases readability in formulas 
involving binary convex combinations. The ^ operation satisfies the important 
relations 

a ^ a, a + f3 = a + (3~l, a/3 — a + P~ap. 
Given a set X E Set, we call 



Ax^ if -.X ^[0,1] 



f has finite support and /(a;) = 1 



the simplex over X. We also consider Ax as the set of all finite formal convex 
combinations XiX^ with Xi £ X , where we use the underline notation x,^ to 
emphasize that the sum is formal; this allows us to distinguish x E X from x e Ax. 
Two formal convex combinations represent the same element of Ax if and only if 
they assign the same total weight to each element x G X. 

3. Defining convex spaces 

We first define convex spaces and convex maps before turning to a formal justi- 
fication of these definitions and proving a certain uniqueness property of a convex 
space structure. 

Definition 3.1. A convex space is given by a set C together with a family of binary 
convex combination operations 

ccx-CxC — >C, A e [0, 1] 

that satisfies 



The unit law: 
Idempotency: 



cco{x,y)^y (3.1) 
cc\{x, x) — X (3.2) 



• Parametric commutativity: 

cc\{x, y) = cci^xiy, x) (3.3) 
Deformed parametric associativity: 

ccx{cCf,{x, y),z)^ cc^{x, ccj,{y, z)) (3.4) 
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with 



A = A/^, /i = 

The most obvious example for this kind of structure is a vector space, with 
convex combinations defined via the vector space structure as ccx{x, y) = Xx + Xy. 




Definition 3.1 is the picture of convex space that we shall work with. Usually, 
a convex space will be referred to simply by its underlying set C, with the convex 
combination operations ccx being implicit. Also, instead ofcc\{x, y), we will usually 
use the more suggestive notation 

Xx + Xy = ccx{x,y) 



in which the laws (3.1)-3.4 now read 



Ox + Oy = y (3.5) 

Xx + Xx — X (3.6) 

Xx + Xy — Xy + Xx (3.7) 

X {fix + Jly) + Xz = Xfix + Xji i X-^y H z [ (A/i 7^ 1) (3.8) 

V A/i A/i / 

Also, we will occassionally use convex combinations 



XiXi, Ai > 0, Aj ^ 1 



i=l 2=1 



of more than two elements. This are to interpreted as iterated binary convex 
combinations. Appropriate normalizations have to be inserted, e.g. for n = 3, 

Xixi + X2X2 + X3X3 = A3 ( ^\ xi + X2] + X3X3. 



(Note that A3 = Ai + A2.) Deformed parametric associativity (3.4 1 then expresses 
the fact that this reduction to binary convex combinations does not depend on the 
order of bracketing. 

Definition 3.2. Given convex spaces C and C , a convex map from C to C is a 
map f : C C that commutes with the convex combination operations: 

f{Xx + Xy) = Xf{x) + Xf{y). 

Convex spaces together with convex maps form the category of convex spaces ConvSpc . 

For example, a map between vector spaces is convex if and only if it is affine. 
Therefore in this context, the words "afhne" and "convex" will be used synony- 
mously. 

We now turn to the technical task of justifying these definitions. The goal here 



is to justify these definitions: why are the compatibility conditions (3.11 to (3.4) 
sufficient to guarantee that the binary operations have all the properties we expect 
convex combinations to have? A less formally inclined reader may want to skip the 
remainder of this section. 
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So, what should a convex space formally be? Clearly, it has to be a set C together 
with some additional structure. This additional structure should make precise the 
intuition of an assignment 



m:Ac — >C, ^\iX.^^^\i 



(3.9) 



mapping & formal convex combination (X]"=i ^i3±i) G to an actual convex com- 
bination (X]r=i ^i^i) ^ such a way that the properties 



m(x) — X, 



m 



n nii 
= m I ^ ^ X^^l^jX^ 
= 1 J = l 



(3.10) 



hold. This intuition is straightforward to make precise using the theory of monads 
and their algebra^ The following definition is a discrete version of the Giry monad 
studied in categorical probability theory jGir82] . 

Definition 3.3 (the finitary Giry monad). We define the simplex functor A to be 
given by 

A : Set ^ Set, C ^ Ac, {c ^ T^) ^ ^ ^'ZM^ ' 

Then the finitary Giry monad ^^^,1 = (A,7y,/i) is defined by the unit natural trans- 
formation 

ric ■■ C ^ Ac, xt-^ X 
and the multiplication transformation 



n nii 



n mi 



A*c : A Ac ^ Ac, XI ^» 51 



X! X! l^iO-\ 



An algebra of is given by a set C together with a structure map m : Ac — > C, 
such that the diagrams 



C 



C 






(3.11) 



commute. As can be seen directly from the definition of J^fin, these correspond 



exactly to the requirements (3.101. Hence, one definitively "correct" definition of 
convex space is given by 

convex space = ^fin-algebra. 



^As pointed out by Leinster |Lei08| . defining convex spaces in terms of an operad does not 
yield all properties that one desires; in particular, taking some convex combination of a point with 
itself would not necessarily give that point back. Therefore, defining them as algebras of a monad 
seems like the most canonical choice. 
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Remark 3.4. Since most of the applications we have in mind do not require convex 
combinations of infinitely many elements, it is sufficient to work with this finitary 
version of the Giry monad. The advantage of this is that it gives a purely algebraic 
description of convex spaces, thereby facilitating the reformulation [XT] However for 
applications in which one needs a structure that allows to take convex combinations 
of infinitely many points, or more generally taking the barycenter of an arbitrary 
probability measure, one could define an ultraconvex space to be an algebra of the 
Giry monad based on the functor V : Meas — )■ Meas, where Meas is an appropriate 
category of measurable spaces. V maps each measurable space to the set of all its 
probability measures, together with an appropriate cr-algebra on that set. Algebras 
for the Giry monad over the category of polish spaces have been studied in |Dob06j . 



We now turn to the category of stochastic matrices FinStoMap that was intro- 



duced in |Fri09] . We will see later that a structure (3.9 1 satisfying (3.101 also turns 
C uniquely into a model of the Lawvere theory FinStoMap°P, and vice versa. So, 
we now proceed to study what it means for a functor L : FinStoMap°P — > Set to 
be product-preserving. For any C £ Set, consider the functor 



: FinMap' 

c 



Set, [n]K^C''" 

((Xi, ...,Xn)^ (2^/(1), ■ • ■,Xf(rn))) 



Using the notation of [Fri09 . the following well-known observation arises: 

Proposition 3.5. Consider a functor L : FinStoMap°P — > Set with L{[n]) — C^" 
for all n e Nq. Then the following conditions are equivalent: 
(a) L is product-preserving, i.e. 

L (^(^ = (c^"i xC^"2 J^c^"i) 

(3.12) 



for all ni,n2 G No, where pi and p2 are the product projections in Set. 

(b) L maps (E) to x. 

(c) The diagram 




commutes. 
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Proof, (a)^(b): This follows from an application of L to the FinStoMap-coproduct 
diagram 



[ni + n2\ 
A 



[n2] 



mi 



[mi + m2\ 



[ma] 



together with the product universal property in Set. 

(b)=>(c): Since L(d) is necessarily the unique map C ^ we know that the map 

L(a®'= ® id[i] ® a®') : c^('=+i+') c 

is the projection onto the {k + l)-th factor. Then for / e FinMap([m], [n]), the 
assertion follows from an application of L to the equation 



i[i] 



, ^«.(n-/(fe))^ 



(c)=5>(a): The equations (3.12) are the special cases of the commutative diagram 

□ 



where one starts in FinMap with the coproduct inclusions. 
We now claim that the equation 

L{A){xi, . . .,Xn) =1^1 "^Aix, , . . . ,m 



(3.14) 



uniquely determines a structure of FinStoMap°P-model i on a set C from a %n- 
algebra structure m : Ac C, and vice versa. Furthermore, we claim that this 
correspondence is such that morphisms of ^^gn-algebras coincide with morphisms of 
FinStoMap°P-models. 



We first check that when m is given, then L defined by (3.14) is a product 



preserving functor. Functoriality is expressed by preservation of identities, 

L{ln){xi, . . . , x„) = (m(xi), . . . , m(x„)) {xi,...,Xn), 

and contravariant preservation of matrix multiplication for A : [m] —^ [n] and 
B : [n] [q]. For the verification of the latter, we have to evaluate the expression 

L (BA) (xi, ...,x,)= (^^{BA)ax}j , • . ■ , m |^^(SA)„„a;,^ ^ . 

We do this componentwise, where k e [m] is the component index, 

/ 9 \ / 



[L{BA) (xi,...,x,)]. 



\i=l 



I A^C I 51 ^ B,. 

j = l 1=1 
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m I ^Aj-fc [L{B){xi,...,x^)]^ 



^ [L{A) {[Lm^i, • • • , , • • • , [Lm^u- ■ ■ , ^,)]J] , 



^[L{A)L{B){xi,...,x,)],, 

thereby showing that 

L{BA){xi, ...,xg) = L{A)L{B) . . . , x,) , 
which completes the verification of functoriahty. Preservation of products is imme- 



diate, as the condition (3.131 holds by (3.141 and the first diagram of (3.11 1 



Now given two ^^fin-algebras m : Ac C and m' : A^' ^ C, a morphism of 
algebras is a map f : C ^ C such that the diagram 



Ac Ac 



f 



(3.15) 



commutes. Then the induced functors L and L' behave with respect to / in the 
following way: 



[L'iA) (/(xi), . . . , /(x„))], ^ m' ( ^ A^kmij = ^' y^f (J2 ^^^5 

f{[L{A){xi,...,Xn)]) 



thereby showing that L'{A)f^" = f^"^L{A), which means that / also is a morphism 
of FinStoMap°P-models. 



Now for the other direction: given L, equation (3.14) requires that we define the 
structure map as 

^ [ [ : I I (2^1' • ■ • = i(A)(a;i, . . . ,x„). (3.16) 



We need to verify the desired properties (3.11). The unit condition is essentially 
trivial, 

m{x) ~ L (li) (x) = X 
while the associativity of the action requires more work: 



n 7n 



3 = 1 



m 



n m 
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(xi , . . . , ) 



= L{fJ.\){xi,. . .,Xjn) = L{\)L{fl){xi, . . .,Xm) 

where the matrix fj, = {^^ji)^^^ has columns fli, . . . , jln, and after possibly adding 
dummy terms, we were able to assume that under the large underscore, neither the 
number of terms m nor the Xj depend on i. Since L maps coproducts to products, 
and the columns of the matrix /i are exactly its coproduct components, we can 
continue the calculation with 

= i(A) (L(^i)(xi, . . . ,x™), . . . ,i(^„)(xi, . . . ,x„i)) 



l |3.16[ 



m 



\i=l 



which shows that also the second diagram of (3.11) commutes 



What still remains to check is that morphisms of FinStoMap°P-models also are 
morphisms of the induced ^%n-algebras. This follows from essentially the same cal- 
culation as above: 



m 



' ( A/ (^5] A,x,j j = (^E ^^^-/Mlj = iL'iA) (/(xi), . . . , fix,,))], 



= / ([L(A)(xi, . . . , x„)]) = / A,kx, 

Finally, as the observation concluding these considerations, it follows from the 
uniqueness statement of the correspondence m «^ L that the construction of L 
from m is inverse to the construction of m from L. 

Remark 3.6. This correspondence between algebras of a monad and models of 
a Lawvere theory is a particular instance of a well-known general correspondence 
between finitary monads and Lawvere theories |HP07j . (A monad is called finitary 
if the endofunctor preserves filtered colimits.) 

Hence, we now have two definitively correct possible definitions of convex space: 
a 5fin-algebra, or a model of FinStoMap°P. We can now apply theorem |Fri09l 3.14] 
to show that the compatibility requirements of definition |3.1| do indeed give all the 
relations |3 . 1 0| that we expect convex combinations to have. 

Proposition 3.7. Given a set C together with a structure of F±iiStona.p°P -model 
in terms of a product-preserving functor L : FinStoMap°P — > Set, the operations 




ccx = L{cx) 



(3.17) 



10 



TOBIAS FRITZ 



define the structure of a convex space on C. Conversely given cc\, there is a unique 
L such that (3.17) holds. 

Proof. This is the main apphcation of theorem |Fri09l 3.14]. First note that due to 
proposition |3.5[ any product-preserving L satisfies 

L{d) : C ^ *, X 1-^ * 

L{e) : C ^ C X C, x i-^ {x,x) 

L{s) : CxC^CxC, {x,y)^{y,x) 

Hence, L is automatically compatible with the relations [Fri09l (2)-(7), (11), (12)]. 

However, L also needs to preserve the other relations of FinStoMap'. In exactly 
this order, preservation of each of the relations j FriOQI (8), (9), (10) and (13)] is 
equivalent to one of the requirements (3.1) to (3.4 1. □ 

We now turn to proving that the category ConvSpc enjoys a certain rigidity 
property expressed by theorem |3.9[ 

For the following lemma, consider the family of maps on the unit interval [0, 1] 
that is given by 

/yo/yi : [0> 1] — ^[O:!]. xi-^xyo + xyi, yo, 2/i G [0, 1]. 

Lemma 3.8. (a) The unit interval [0, 1] has a unique structure of convex space 
in which all of the fy„,y^ are convex maps, 
(b) For every convex space C and every pair of points x,y C, there is a unique 
convex map g^^y ■ [0, 1] C with g(0) = x and g{l) = y. 

Proof, (a) In order to distinguish elements of the convex space [0, 1] from coefficients 
in [0, 1], we distinguish the fomer by means of the underline notation ■_. 

We first show that the convex combination ^0 + ^1 is necessarily equal to 1/2. 
To this end, consider the fiip map fi,o'. 



1 



1. 



1 



1 



1 



f^^^ - 2^^'°® + 2^^^°(i) - 2i+ 2^^ - 2^^+ 2^ 

Hence, the assertion follows from the fact that 1/2 is the unique fixed point of /i^q. 
But then also for any pair x^y € [0, 1], we have that 



J?/ = ^fx,y (Q) + ^fx.y (1) = fx 



-0 



fx 



Next, we claim that when x < y, p,q E Nq and A £ (0,1) with q2 ^ < A < 
{q + l)2~P, then 



(3.18) 



(Ax + Ay) e q2-Px + q2-Py, {q + 1)2-p.t + {q + 1)2"^^ 

We prove this by induction on p. For p = 0, this is given by 

Xx + Xy^ fx^y (AO + Al) e im {fx,y) = [x, y] . 
For p> 1, consider the case A > 1/2 first, which is equivalent to g > 2^^^. Then 
{q - 2P-1) 2-(P-i) < 2A - 1 < (g + 1 - 2P-1) 2-(f-i) 

so that 



Xx + Xy ^ 2X 



^x+^y]+{2X-l)y- 



2X 



1 



1 



+ -y +(2A-l)y 
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which, by the induction assumption, is bigger than or equal to 

(g-2f-i)2-(P-i) + + {q - 2P-')2-(P-'^y = W^x + q2-Py, 

as was to be shown. The upper bound works in exactly the same way. The case 
A < 1/2 can either be treated in a similar way, or can be reduced to the case A > 1/2 
by an application of the flip map /i.o- 



But then by the principle of nested intervals, equation (3.181 shows that Aa; + 
Xy = Xx + Xy, which concludes the proof. 

(b) For A G [0, 1], the requirements imply that we need to set 

g{X) = Xx + Xy. 

We now verify that this is indeed a convex map. With /i, Ai, A2 G [0, 1], we have 

g (^Ai + JIX2) = (^iAi + 11X2) X + (^Ai + 71A2) y. (3.19) 
We proceed by evaluating the first coeflicient further. 



(/iAi + ^A2) = fiXi + ^X2 - 1 
= + Ai - JlXi + fi+ X2 - HX2 - 1 = iJ-Xi + JIX2 



proving that (3.191 yields 

g (^Ai + JIX2) = ^J. (Xix + Xiy) + Jl (X2X + X2y) = fJ.g{Xi) + Jlg{X2), 
as was to be shown. □ 

Theorem 3.9. The identity Junctor is the only endofunctor o/ConvSpc that makes 
the diagram 

ConvSpc ConvSpc 




Set 

commute. 



Proof. Let E : ConvSpc — > ConvSpc be such an endofunctor. Commutativity of the 
diagram means that for any C,C' E ConvSpc, E{C) and E{C') are convex spaces 
with the same underlying sets as C and C, respectively, such that 

ConvSpc (CC) C ConvSpc (£;(C),i;(C')) ■ (3.20) 



Now consider C = C = [0, 1]. Then it follows from lemma [S^S^a) that E{[Q, 1]) = 
[0, 1] with the standard structure of convex space. 

Now consider C = [0, 1] and C arbitrary. Then by lemma [3^ b) , we know that 
for any x,y E C, 

Xx+ Xy = gx.yiX). 



Therefore, the structure of convex space on E{C') is uniquely determined by (3.20 1 



showing that E{C') = C . □ 



Remark 3.10. Theorem 3.9 displays a rigidity of ConvSpc that is far from valid 



for other categories of algebraic structures. For example for the category of groups 
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Grp, there is a non-trivial automorphism -"p : Grp — > Grp, given by mapping each 
group to its opposite group, such that the diagram 

Grp — s- Grp 




Set 

commutes. Hence, the direct analogue of theorem |3.9| for groups is false. 

4. Convex spaces of geometric type 

The first main class of examples of convex spaces are the convex subsets of vec- 
tor spaces, which will be discussed now. We will refer to those convex spaces that 
can be embedded into a vector space as convex spaces of geometric type. These 
are the convex spaces studied in convex geometry. We are aware that many rele- 
vant properties of a convex set do depend on an explicit embedding into a vector 
space: for example, the volume or the number of points with integer coordinates 
are properties that are not invariant under affine transformations and therefore are 
not invariants of the convex space structure alone. Nevertheless, we hope that the 
theory of convex spaces |Frij might be able to shed new light on some aspects of 
convex geometry in general and some of the following examples in particular. 

We will see in the upcoming two sections that there are also interesting examples 
of convex spaces that are not of geometric type. 

Theorem 4.1 (convex spaces of geometric type). Given a real vector space V and 
a convex subset C '^V , the vector space structure of V turns C into a convex space. 

Proof. This is clear by defining the convex combination operations ccx via the 
vector space structure in the obvious way as 

cc\{x,y) = Xx + \y 



since then the equations (3.1)-(3.4) follow easily from the vector space axioms. □ 



The map which turns every such convex set into a convex space is functorial in 
the following sense: consider the category of convex sets, where objects are pairs 
(y,C) with V a real vector space and C C V a, convex subset, and the morphisms 
lv,C) iV'.C) are the affine maps f : V ^ V with /(C) C C . Then each 
morphism / restricts to a convex map between convex spaces f\c ■ C ^ C . This 
construction is clearly functorial. 

All examples following now are convex spaces of geometric type. In each case, 
we also describe how the convex space arises as a convex subset of a vector space. 

Example 4.2 (free convex spaces). Given a set X, the simplex Ax is a convex 
subset of the vector space M.^ . Alternatively, we can regard Ax as the set of 
formal convex combinations of elements of X. In this interpretation. Ax is the 
"free" convex space generated by X in the sense of a functor Set ConvSpc left 
adjoint to the forgetful functor ConvSpc Set. This property is clear from the 
monadic definition of convex spaces, where A. figures as the underlying functor of 
the monad J^fin. As a third point of view. Ax can also be regarded as the set of 
finitely supported probability measures on X. 
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Example 4.3 (probability measures). As a variant of the previous example, we 
may consider a set X together with any cr-algebra C 2^, turning (X, fi) into 
a measurable space. Then the set of probability measures on {X, fi) is a convex 
subset of the vector space M^. We denote this convex space by A(x,a)- 

Example 4.4 (invariant measures). Let (X, il) be a measurable space together 
with an action of a group G or monoid G given by a homomorphism G — > End(X). 
For example when G = (M, +), this action turns X into a dynamical system. Then 
the set of invariant measures, which are those probability measures that are pre- 
served by the action of G, form a convex subspace of l^(^x,n)- Of particular im- 
portance are the ergodic measures as those that cannot be written as a non-trivial 
convex combination of other invariant measures. 

Example 4.5 (conditional probability distributions / classical communication chan- 
nels). Given measurable spaces (X, f2x) ^^nd (Yjfly), a conditional probability dis- 
tribution on Y dependent on X is defined to be a convex map A(x,Ox) ~^ ^{yAy)- 
Such a map describes a classical communication channel, where an input x € X is 
represented by the Dirac measure on x and gets mapped to a probability distribu- 
tion of noise-affected possible outputs y G Y. The set of all such maps is a convex 
space under pointwise convex combinations. 

Example 4.6 (states on C*-algebras). Given a C*-algebra A, a state on A is 
a positive linear functional (j) : A C of unit norm. The states on A form a 
convex subset of the vector space C"^. In the case A = B{Ti.), this convex space is 
isomorphic to the convex set of unit trace positive trace-class operators on 7i, the 
so-called density matrices. Upon setting Hn = C" for n e N and = £'^{N) for 
n = oo, the set of density matrices is given by 

Q„ = {p G BiHn) \p>0, tr(p) = 1} . 

This family of convex spaces is widely studied in quantum information theory. As a 
first example of how much information the convex space structure on Q„ contains, 
we show that one can use it to recover the scalar product of 7i„, at least up to a 
phase factor. This is achieved by the formula, depending on unit vectors ji/'i) and 

IV'2), 

Vl - I (V'l 1^-2)12 - _ max /(|^i)(^i|)-/(|V2)(V'2|) . (4.1) 

J'-Qn — *10,1J convex 

In order to prove the correctness of this equation, we consider the case n = 2 first. 
Then \tjji) and -02) can be identified with points on the Bloch sphere. The angle 
between these points, as seen from the center of the sphere, is given by 

cosa |('(/'i|V'2)P, ae[0,7r] 

since the map p i— > tr(p|i/)i)('0i|) is convex and can therefore be identified with a 
cartesian coordinate for the sphere. This situation is illustrated in figure [l] 

Now when / is a [0, l]-valued convex functional on the Bloch ball, the value 
1/ (1-01) (V'l I) ~ / (1 02) (02 1) I is maximal at most when / attains both and 1. Then 
we call /~^(1) the "north pole" and /^^(O) the "south pole"; these points are 
clearly unique and diametrically opposite. Also it is clear that an optimal / will 
be such that lipi) and |02) are aligned symmetrically with respect to the equator. 
Then, 

/(l'/'i)(0i|) = I + ^sin (I) , /(|0.2)(02|) = 2 - (f ) 
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^ ^~ l^i; 

rHi/2) \ 

rHi/4) 

Figure 1. A two-dimensional section of the Bloch ball containing 
the states and |'02)- The level sets of the optimal functional 
/ are shown with pointed lines. 




so that 



1/ (IV'i)(V'i|) - / (|V'2)(^2|)| = Sin (I) = v/l-|(V'i|V'2)P, 



as was to be shown. 

For general n, consider the Hilbert space spanned by jV'i) and |'02)- When IV'i) 



and IV'2) are linearly dependent, (4.1) holds trivially, hence we may assume the 
span to be two-dimensional. This yields an embedding Q2 ^ Q.n- In this way, 
every convex functional Q„ [0, 1] can be restricted to Q2 — > [0, 1], and then the 



">" part of (4.1 1 follows from the previous considerations. On the other hand, the 
/ constructed in the two-dimensional case is of the form p 1— > (^^\p\'\\})^ where is 
an appropriate linear combination of 1-01) and |'02)- Therefore, this optimal / can 
actually be extended to all of Q„, so that this ">" bound is in fact tight. 

Example 4.7 (KMS states). A KMS state is a certain kind of state on a C*-algebra 
relevant for equilibrium thermodynamics. 

In statistical physics, thermal equilibrium of a system with its environment is 
described by an equilibrium state depending on the temperature. This state is 
usually given by the canonical ensemble's density matrix p = Z{(3)~^e~^^ , where 
/3 = l/kT is the inverse temperature of the system, H stands for its Hamiltonian, 
and Z{(3) — tr(e~^^) denotes the partition function. However in some cases, the 
trace in the definition of Z((3) need not converge, such that the canonical ensemble 
does not exist. For example in the context of spontaneous symmetry breaking, 
there is clearly no unique equilibrium state. In these situations, equilibrium ther- 
modynamics has to be phrased in terms of KMS states. 

We now describe the notion of KMS state in detail. On the quantum level, a 
system is described by its C*-algebra of observables A and a one-parameter group 
of automorphisms at : A ^ A; typically, this group is given by the Heisenberg 
picture time evolution at (a) = e*'^*ae~*'^*. Then by definition, a state (p : A C 
is a Kubo-Martin-Schwinger (KMS) state [KM08a p. 178] for inverse temperature 
(3 if and only if for all a,b d A, there is a continuous function Fa^tiz) defined on 
the strip < Im(z) < (3, and holomorphic on the interior of the strip, such that 



(4.2) 
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It is then clear that the KMS states for fixed (3 form a convex subset of the convex 
space of all states on A. As a plausibility check, one may observe that the canonical 
ensemble ip{a) = Z{l3)~^tr{e~^^ a) is a KMS state whenever the partition function 
Z{(3) = tr{e~^^) converges. 

Example 4.8 (unit balls). Let {E, || • ||) be a normed space. Then the unit ball 

Bi = {xeE\\\x\\<l} 
is a convex space in E. Conversely, the convex space Bi determines the norm via 

INI ^ 



sup{r G M>o I rx e Bi}' 
The same applies to seminorms. 

Example 4.9 (torus actions on symplectic manifolds). This is material taken from 
the book [Aud04j . 

Let (M, w) be a compact connected symplectic manifold together with a col- 
lection of Hamiltonian functions Hi , . . . , Hn such that the Hi pairwise Poisson 
commute and generate (almost) periodic flows. Then the image of the map 

/:M^M", x^{Hi{x),...,Hn{x)) 

is convex. 



The proof of this result follows from proposition 4.10 together with the statement 
that all the level sets f~^{t), t G M", are empty or connected. The latter is a deep 
theorem the proof of which heavily relies on Morse theory. 

Proposition 4.10. Let X be a topological space and T a collection of functions 
f -.X ^ such that 

• J- is closed under composition with linear projection maps M"^, 

• all level sets f~^(t), f E T, t £ Ws , are empty or connected. 
Then im(/) C M"/ is convex for every f £ T . 

Proof, (see also |Aud041 p. 114].) We need to show that the intersection of im(/) 
with every afline line in W^f is connected. To this end, choose such an afhne line 
and some linear projection tt : M"-f M"^^^ that maps this afhne line to a point. 
The inverse image of this point under tt is just the given afline line. Then by 
assumption, the preimage of this afhne line in X has to be connected, therefore 
showing that the intersection of im(/) with this afline line also is connected. □ 

The statement of the next example can be proven by applying a certain reflne- 
ment of example |4.9[ We refer to |Aud04i IV. 4. 11] for more details. 

Example 4.11 (the Schur-Horn theorem). Consider an n-tuple of not necessarily 
distinct numbers Ai, . . . , A„ € ffi. Then there is a hermitian n x n-matrix A with 
d\a,g{A) = (oi, . . . , a„) G E" and eigenvalues Ai, . . . , A„ if and only if 

(ai,...,a„) G conv({ (A^(i), . . . , A^(„)), a G Sn]) 

where conv(-) stands for the convex hull in M" of its argument and 5„ is the group 
of permutations of [n] . 

Example 4.12 (metrics). These are actually two related examples. For the flrst, let 
X be a set. A metric on X is a function d : X x X — > K>o satisfying deflniteness, 
symmetry, and the triangle inequality. A convex combination of two metrics is 
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0.0 0.1 02 0.3 0.4 0.5 0.6 0.7 O.S 



Figure 2. The CIE 1931 color matching functions and the result- 
ing chromaticity diagran^ The curved part of the boundary is 
formed by the monochromatic colors of the specified wavelengths. 

again a metric. Therefore, the set of metrics is a convex space of geometric type 
lying in the vector space K^^'^. 

For the second example, consider a manifold M and the set of Riemannian 
metrics on M . A Riemannian metric is a positive definite symmetric tensor of 
rank (0, 2) on M . Therefore, the set of Riemannian metrics is a convex space of 
geometric type lying the vector space 7j'(M) of all rank (0,2) tensors on M. 

Example 4.13 (non-example: points on a Riemannian manifold). Take C to be 
a subset of a Riemannian manifold, such that each pair of points x,y € C can be 
joined by a unique geodesic [x,y] C C. Upon fixing the afiine parameter A of the 
geodesic [a, b] such that A = at y and A = 1 at cc, one might be tempted to 
define the convex combination Xx + Xy as the point on [a, b] corresponding to the 
affine parameter A. Then this satisfies the unit law, idempotency and parametric 
commutativity. Now assume that deformed parametric associativity also holds, 
thereby turning C into a convex space. Then any triple of points x,y, z € C defines 
a convex map A3 — ^ C that maps straight lines to geodesies. But then by virtue of 
the geodesic deviation equation, the manifold is fiat along the triangle spanned by 
X, y and z. Since this triple was arbitrary, the manifold is fiat on all of C. Conversely 
if the manifold is fiat on C, we are exactly in the situation of theorem |4.1| 

Example 4.14 (color perception and chromaticity). The physical color of light 
is given by its spectral density /(A), where I{X)dX is the intensity of light in the 
wavelength interval [A, A + dX]. Hence a priori, there are infinitely many physical 
degrees of freedom in the spectrum. However since the human eye only has three 
different kinds of receptors, our perception projects this two a three-dimensional 
space, which we perceive as three different kinds of visual colors. 

More formally, a physical color is defined by a finite measure dfj, on the space of 
wavelengths [0, 00). The corresponding visual color is obtained by integrating c?/j, 



Both images were copied from http : //en. wikipedia. org/wiki/CIE_1931_color_space using 
the GNU FDL. 
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with respect to three non-negative color matching function^x{X) , y(A), z{X): 

J x{X)dfi 

Z ~ j z{X)d^. 

Hence we get a convex map from the convex space of all finite measures on [0, cxd) to 
the convex space M>o, such that scaling the measure by a non-negative constant also 
scales all {X,Y,Z) by that constant. The chromaticity diagram in figure [2] depicts 
the image of this convex map in a two-dimensional cross-section which corresponds 
to restricting to colors of specified brightness. Since the image of any convex map 
is convex, so is the color region of the chromaticity diagram. Morally speaking, we 
can think of any physical color as a free convex combination of monochromatic 
colors, i.e. Dirac measures on [0,cx)). Then every visual color in the chromaticity 
diagram is a convex combination of monochromatic colors. 

Convex sets also feature prominently in many kinds of optimization problems. 
We start with a particular example of a linear programming problem. 

Example 4.15 (static friction for rigid bodies). Consider a long and thin rod with 
quadratic cross-section lying on a flat surface. Then upon application of a small 
force along the side of the rod, the static friction between the rod and the surface 
keeps the rod from sliding. The question is: under the assumption that the force 
applies on the side of the rod towards its end, how big can that force be without 
the rod starting to slide? The situation is illustrated in figure |3] 

We assume all physical parameters (mass and length of the rod, coefficient of 
friction, . . . ) to be known and set them to unity without loss of generality. Then 
as shown in the figure, the friction forces along the rod are described in terms of a 
linear density f{x) with the constraint that there is a maxmial amount of friction 
for each length element, so that |/(a;)| < 1. Now upon application of a small 
enough force F, the friction will adjust in such a way that the force is balanced, 
i.e. F + Cy f{x)dx — 0, and torque is balanced, i.e. xf{x)dx — 0. Hence the 
maximal force that can be applied is given by the solution of the linear program 

-l</(a;)<+l 
/g xf{x)dx = 

max ^ Jg f{x)dx^ 

As always in linear programming, the set of admissible solutions f{x) is determined 
by a set of linear equalities and inequalities, and therefore is convex. We can solve 
this problem by introducing a Lagrange multiplier /i for the equality constraint, 
and solving the optimization problem 

-l</(a^)<+l 
max ( f{x)dx + /i xf{x)dxj = max ( {/ix + 1) f{x)dxj 



Note that for technical reasons, these do actually not coincide with the response functions of 
the eye's receptors. 
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coordinate y and force f{x) 

max- 



r 



-ey So f{x)dx \- 



min - 



J 



Figure 3. Candidate distribution of static friction along a thin 
rod upon application of the force F. The dashed Unes indicate the 
contour of the rod as seen from above. 



It is clear this problem has a unique optimal solution given by 

holds if and only if 



for 
for 



lix - 
fix ■ 



1 > 
KO 



Then the torque constraint xf(x)dx 
the optimal configuration is given by 



-V2, so that 



+ 1 
-1 



r(^) = { 

With this result, we determine the absolute value of the maximal force to be 



for X < 1/V2 
for X > Iv^ 



F = [ f*{x)dx = V2-1. 
Jo 



We expect that these considerations can be generalized to arbitrary rigid bodies 
in ]R". To this end, / will have to be replaced by a vector-valued function f{x) 
restricted such as < p{x), where p is the rigid body's density distribution, 

while there will be one linear constraint for each component of the total torque. 
Then the set of admissible /(.x) is a convex space that comes with a convex map to 
the vector space of all potential forces acting on a certain point of the rigid body. 
The forces that can be applied at that point without the body starting to slide are 
exactly given by the image of this convex map. 

Introducing a Lagrange multiplier as above is a special case of duality theory 
for linear programs. Hence the following question arises; when formulating convex 
programming in the context of convex spaces, is there a nice notion of duality 
that generalizes the classical Karush-Kuhn- Tucker theory? What axe appropriate 
constraint qualifications guaranteeing strong duality? 

Since linear programming is a relatively easy optimization problem, one tries to 
reduce other optimization problems to the linear case. This is done for combinato- 
rial optimization problems in particular, and hence convex spaces might also be of 
relevance for those. 
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Example 4.16 (combinatorial optimization). For us, a combinatorial optimization 
problem is given by a finite set X = {xi, . . . , a;„} (the search space) and a linear 
subspace 

OT C 

that is the class of all possible objective functions. A particular instance of the 
problem is then given by specifying some / € OT, and the task is to find the 
optimal value 

max f{xi) = ? . 

i=l,...,n 

Typically, n is so large that brute-force enumeration of the search space is practically 
impossible, and therefore one needs to exploit the structure of OT as the way it 
lies inside M.^ . 

For example, let X be the set of all Hamiltonian cycles in a finite graph G, and 
OJ- the set of all functions on X which one obtains by assigning a weight to each 
edge of G and mapping a Hamiltonian cycle to the sum of its edge weights. In this 
way, one obtains the famous travelling salesman problem on G. 

Since all that matters is how a candidate point Xi behaves under objective func- 
tions, we can identify Xi with the evaluation map 

x,:OT^R, f^f{xi). 

In this way, X becomes identified with a finite subset of MP-^ . Now consider the 
polytope 

P = conv({a;i,...,a;„}) C M*^-^. 

Then each / G OJ- turns into a convex map f : V ^ M.. In practice, one tries 
to describe V in terms of linear inequalities, which reduces the combinatorial op- 
timization problem to a linear optimization problem. For example in case of the 
travelling salesman problem, V is the travelling salesman polytope over G. 

It is clear that no list of relevant examples of convex sets could ever be complete. 
Therefore we simply end this list here by mentioning some particularly severe omis- 
sions: 

• Poly topes in general |Zie95| as a certain kind of finitely generated convex 
spaces. 

• In particular, lattice polytopes and their relation to toric varieties |Ful93] . 

• The geometry of numbers |Sie89j studying integer points (potentially over 
number fields) in convex subsets of M" . 

• The Bernstein-Kushnirenko theorem expressing the generic number of non- 
trivial solutions to a system of polynomial equations in terms of a geometric 
invariant of a collection of polytopes ^Stu98j . 

• The set of Bayesian networks on a fixed directed acyclic graph |KM08bj . 

5. Convex spaces of combinatorial type 

Now we turn to convex spaces that cannot be embedded as convex subsets of 
vector spaces. The smallest of these is a convex space structure on a two-element 
set. 
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Example 5.1 (two-point convex space). Let TC ~ {«,/} be a two-element set, 
and define convex combinations of the two elements as 

\ - , f / if A = 



i if A 7^ 

This satisfies all the axioms for a convex space. 

Naively, one would deem the previous example pathological. Earlier on in the 
study of convex spaces, we were also trying to exclude such cases by changing 
the definition of convex space by requiring C to be a topological space and the 
convex combination operations to be continuous. However, we soon found out 
that example |5.1| is just a special case of a very natural class of convex spaces of 
combinatorial type, which should not be considered pathological at all. One reason 
is that TC from the previous example turns out to be the T&ce Classifier for convex 
spaces |Frij . with / representing a /ace and i the interior complement. Another 
reason is remark 



Definition 5.2. A convex space C is said to be of combinatorial type if each 
function 

(0,1) — >C, X>^Xx+Xy 

is constant. 



Then when combining this definition with the axioms (3.11-3.4 we see that a 
convex space of combinatorial type is nothing but a set C together with a binary 
operation 

cci : C X C — > C 

2 

which is idempotent, commutative and associative. It is well-known that such an 
algebraic structure is exactly the same thing as a meet-semilattice, which is a poset 
(C,<) such that each pair of elements has a meet, i.e. a greatest lower bound. In 
the following, the term semilattice always stands for meet-semilattice. 

We digress briefly to describe the monad and the Lawvere theory underlying 
semilattices. The monad is a version of the powerset monad (or Manes monad) 
and is defined over the functor that maps every set to the set of its finite nonempty 
subsets. 

Definition 5.3 (the finitary Manes monad). The finitary Manes monad = 
('7^fin,£,w) is given by the functor 

V-.Set^ Set, A ^ ViA) = {B C A \ B ^ $ is finite} 

with the obvious action on morphims, the unit natural transformation 

£A- A-> VA, X {x} 

and the multiplication transformation 

ujA ■■ VVA -fVA, \j B. 

Bee 

The Lawvere theory of semilattices is the category FinMultiMap of finite cardi- 
nals together with multivalued functions. 

We can now see how both the monad and the Lawvere theory underlying convex 
spaces of combinatorial type are related to ^^fjn and FinStoMap. To this end, con- 
sider the semiring ^2 = {0, 1} with 1 + 1 = 1. Then the monad originates from 
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by replacing the IR>o-coefRcients of ^fin by 52-coefiicients. In the same way, 
FinMultiMap originates from FinStoMap by making the same change of coefficients: 
a multivalued function [m] [n] is the same thing as a matrix M„xm(<52) that is 
"stochastic" in the sense that all coefficients sum to 1. 

More formally, changing coefficients along the semiring homomorphism 

R>o ^ ^2, A sgn(A) 

yields a morphism of Lawvcrc theories FinStoMap°P — > FiiiMultiMap°P and a mor- 
phism of monads ^ifgn ^fin given by 

Ax ''PiX), ^ XiXit^ {Xi,...,Xn} 

i with Ai>0 

These morphisms imply that a semilattice naturally carries a convex space struc- 
ture. 

Remark 5.4. What docs this change of coefficients mean in the information- 
theoretic interpretation of convex spaces? The answer is that 52 coefficients only 
care about qualitative possibilities, while M>o coefficients contain information about 
quantitative probabilities. 

We now give a few examples of semilattices. 

Example 5.5 (free semilattices). Given a set X, the free semilattice over X is 
given by C = together with the partial order 

A,B€ V{X) : A<B^A^B. 

Then the meet of two finite non-empty subsets of X is given by their union. 

Exemiple 5.6 (possibility measures). Given a measurable space (X, fi), a possibility 
measure on {X,Q.) is a map fi : f2 — > [0, 1] such that /i(0) = 0, ^i{X) = 1 and 



\JxA =sup/x(X.) 



for every countable family of subsets G 17. 

Intuitively, \x measures the plausibility an observer assigns to an event. A pos- 
sibility of means that the event is impossible. On the other hand, a possibility 
of 1 means that the event is totally unsurprising, although it need not occur with 
absolute certainty. 

The set of possibility measures on (X, Q) is a semilattice with respect to the 
ordering 

y,<p! ^ p,{Y) < i_i\Y) \/Y G n. 
The meet operation is given by 

(/XiAM2)(l^)=min{^i(F),/X2(y)}. 
Exemiple 5.7. Consider C = N as a partially ordered set with respect to divisibility: 

X <y ^s=> x\y 

Then the meet of two natural numbers is given by their greatest common divisor. 

Hence, (N, |) is a semilattice which encodes some number-theoretic information. 

On the other hand, the decomposition of an integer into its prime factors yields 
an isomorphism of partially ordered sets (N, |) = N^', where P denotes the set 
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of prime numbers, and N^' carries the product order. This means that there is 
nothing to gain from studying the semilattice (N, |) by itself without any additional 
structure. 

6. Convex spaces of mixed type 

The above two types of convex spaces should be considered to be extreme cases. 
In general, a convex space will have a flavor of both the geometrical type and the 
combinatorial type. For example when starting with a convex space of geometrical 
type, the following construction will add a combinatorial flavor: 

Example 6.1 (adjoining a point at inflnity). Let C be any convex space. Then we 
deflne a new convex space as Coo = C U {oo}, where the convex combinations are 
inherited from C together with, for all points a: € C, 

X for A = 
oo for A 7^ 



Aoo + Aa; : 



There is much more general construction lying behind this example: starting 
with a semilattice S, we choose a convex space Cs for each s £ S. The Cg may be 
of geometric type, but this is not required. Now we consider the disjoint union 

ses 

Hence, C is a set over S with flbers Cs- Furthermore, for every relation s < s', we 
choose a convex map Js^s' '■ Cs' — ^ Cs, such that this data amounts to a functor 

/., : 5°P ^ ConvSpc, s^Cs, {s<s')^fs,s' 

where the poset S is considered as a category in the usual way. Now we can deflne 
convex combinations on C as 

A e (0, 1), X eCs, y &Ct : Xx + Xy = X/smA^) + ^fs/\t,t{y) ^ ^sAt- 
Intuitively speaking: for taking a non-trivial convex combination of some point in 
Cs and some point in Ct, we have to transport both of them to Csm first and then 
can take the convex combination there. We denote the resulting convex space by 
C = Sf K C. 



Example 6.1 is subsumed by this construction upon setting S — TC (from ex- 
ample 5.1), Cf =C and Ci = {oo}. The map : C ~* {oo} is trivially unique. 



Example 6.2 (a lottery). Suppose we buy a ticket for a lottery. Also suppose 
that we do not really care about what the prizes are, as long as we win something; 
hence before the results are drawn, we only care about our subjective probability 
of winning p G [0, 1]. But then as soon as we know that we have a winning ticket 
(i.e. p — 1), of course we also become interested in what the prize actually is - the 
possibilities being, say, an apple a or a banana b. Hence in this stage of the process, 
our subjective state of information is given by an element of Aj^j ^j. In total, our 
possible states of subjective information are given by the convex space 

[0,1)U A{,^fc} 

where convex combinations within [0, 1) or within A{(j,6} are the ordinary ones, 
while in addition, for a coefRcient A € (0, 1) and a point p G [0, 1), 

Xp+ X (/ia + Jib) = Xp + X. 
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a 



b 



Figure 4. The convex space from example |6.2[ All points on a 
dotted line are identified, while the points on the line connecting 
a to & stay distinct. 

Intuitively speaking, Aj^ f,} acts on [0,1) by convex combinations with 1. As il- 
lustrated in figure |4] one can view this convex space as the quotient of A{p^o,a,b} 
where all formal convex combinations with fixed positive coefficient of p ~ are 
identified. 

Since 1 ^ [0, 1), this convex space is not of the form 5/ k C. for any S and C. 

Example 6.3 (convex space of convex sets). Let be a real vector space, and 
take C to be the set of all convex subsets of V: 

C = {C<ZV\Cis convex} 

Then convex combinations of two convex subsets Ci and C2 can be defined by 

ACi + AC2 = {Aci + Ac2, c^ e Ci} . 

Except in the degenerate case V = 0, this convex space is neither of geometric type 
nor of combinatorial type. For example when = M, we can use open and closed 
intervals to get relations of the form 

^(0,l) + i[0,l]-(0,l), 

which cannot possibly hold in a convex space of geometric type. Similar examples 
abound in higher dimensions. 

When considering only those subsets C CV that are the convex hulls of finitely 
many points, we obtain the convex space of polytopes in V. It is unclear whether 
this convex space is of geometric type. 
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